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Abstract: We implement a propensity score matching technique to present the first 
evidence on the impact of labor supply decisions during labor disputes on worker productivity 
in the context of professional sports. In particular, we utilize a unique natural experiment 
from the 2012-13 National Hockey League (NHL) lockout, during which approximately 200 
players decided to play overseas while the rest stayed in North America. We separate the 
players based on their nationality and investigate the effect of playing abroad on post-lockout 
player performance. We hnd limited evidence of enhanced productivity among European 
players, and no evidence of a beneht or drawback for North American players. The lack of 
consistent productivity impact is in line with literature in industries with large labor rents, 
and we propose several additional explanations within the context of professional hockey. 
Our study contributes to the general understanding of the impact of employer-initiated 
work stoppage on labor productivity. 
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1 Introduction 


Workers are highly sensitive to pay adjustments. Unsuccessful bargaining with the em¬ 
ployers and subsequent work stoppage can easily demotivate workers and lead to frustration 
and stress. Unsurprisingly, economists have long been interested in studying the impact of 
labor disputes on productivity and have explored various forms of labor conflicts and consid¬ 
ered different measures of productivity from both public and private sectors. However, while 
theory predicts that pay reduction or labor disputes can lead to reduced morale which in turn 


causes shirking and lower product quality (Bewley, 1999), there is no empirical consensus on 


the direction of the impact. For instance. Mas (2006) hnds that lower productivity is associ¬ 


ated with disappointing labor arbitration outcomes, Krueger and Mas (2004) demonstrate a 


positive relationship between defective products and and previous incidences of strikes, and 


Chandrasekher (2013) shows that working under expired contract as a result of lengthy con¬ 


tract negotiations can lead to implicit productivity decrease in the form of more professional 


misconduct. On the other hand, Lee and Rupp (2007) suggest limited support for reduced 


effort and productivity among commercial airline pilots when facing pay cuts. 

Among the industries with labor unrest, professional sports is a highly publicized field 
that has witnessed over a dozen incidents of lengthy or failed collective bargaining in the 
past three decades. Almost all of these labor negotiations resulted in player-organized strikes 
or owner-initiated lockouts that led to the loss of part or the entire professional sports sea¬ 
sons. Since the Major League Baseball (MLB) strike in 1994, lockouts have become the 
dominant form of work stoppage in professional sports leagues in the event of unsuccessful 
collective bargaining. Understandably, there is no lack of media coverage on these lockout^ 
Meanwhile, professional sports has generated a lot of recent scholarly interest in empirical 
research because it provides detailed and publicly available information on employee salary. 


and there are clear measures of labor productivity in the field (Kahn, 2000). In terms of pro 


^See http; //www.huf f ingtonpost. com/tag/2012-nhl-lockout/ for a list of news updates on the 2012 
NHL lockout 
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fessional sports lockouts, economists have studied the impact of lockouts on local economy 


and employment (e.g. Coates and Humphreys, 2001), consumer demand (e.g. Schmidt and 
Berri, 2004), fan substitution (e.g. Winfree and Fort, [2008), on-ice infractions (e.g. Kahane 


et al., 2013), and competitive balance (e.g. Zimbalist, 2000). Intriguingly, there have not 


been studies that directly explore the impact of lockouts on professional sports player perfor¬ 
mance despite the abundant literature on the effect of labor conflicts on worker productivity. 
On a broader note, despite having grown recently to represent a record percentage of work 
stoppages in the U.S|^ lockouts received considerably less scholarly attention compared to 
strike^ The limited coverage could be attributed to the fact that lockouts were once rare in 
most industries, and employers have historically been favoring letting employee strike instead 
of initiating a lockout because of its legal and worker replacement implication^ With the 
decline of union representation and increasing empowerment to employers in many indus¬ 
tries, it is important to understand the impact of lockouts as an alternative form of work 
stoppage during labor disputes. Professional sports provides an excellent testing ground for 
studying characteristics of lockouts due to its numerous recent lockout incidents and readily 
available sources of productivity data. In addition, professional athletes face the necessity 
and a variety of options to practice their “production skills” during the lockout, and this 
unique feature allows us to explore how player behaviors during the lockout affect post¬ 
lockout performance. Our paper thus seeks to not only bridge a gap in the sports economics 
literature but also provide additional evidence of the impact of lockouts toward the general 
discussion about labor disputes and worker performance. 

In this paper, we study the effect of labor supply decisions under employer-initiated lock¬ 
outs on worker productivity in the context of the 2012-13 National Hockey League (NHL) 


Al. 


^Greenhouse, S. (January 22, 2012). More Lockouts as Companies Battle Unions. The New York Times, 


For example, Hall (20041 is among the few studies that analyze the effect of a lockout outside professional 


sports, but it does not evaluate the impact on worker productivity. 

^For example, the employer in the U.S. may only temporarily hire replacements under lockouts and 
locked-out workers are eligible for benefits. On the other hand, workers on strike may be replaced perma¬ 
nently and may not qualify for benefits. 
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lockout. The 2012-13 NHL lockout provides a unique natural experiment to study our topic 
because during this lockout approximately 200 NHL players chose to play in highly compet¬ 
itive professional hockey leagues in Europe to keep up with their athletic conditioning and 
receive additional compensation, while others decided to stay in North America and either 
trained on their own or played in less competitive domestic games with nominal compen- 
satiorj^ Because the zero-sum nature of hockey games calls for more effort on and off the 
ice to stay competitive and European hockey leagues are the most competitive alternative 
outside the NHL, those players who chose to play in Europe during the lockout were pre¬ 
sumably less affected by the stoppage of games and thus more likely to keep their athletic 
conditioning ready for in-season competition than their peers who chose to stay in North 
America. By comparing the post-lockout performance between players who played overseas 
and players who stayed during the lockout, we are therefore able to gauge impact of players’ 
labor supply decisions during the lockout on their productivity. We separate players based 
on their nationality and consider various productivity measures in professional hockey. We 
then implement a propensity score matching technique to explore the implication of such 
natural experiment on player performance in the resumed new season and derive the aver¬ 
age treatment effect (ATT) of playing abroad among those who chose to play overseas. We 
hnd limited evidence of enhanced productivity among European players who chose to play 
abroad during the lockout. In particular, we hnd that for European players, those who chose 
to play overseas during the lockout had signihcantly more goals per 60 minutes in the long 
run (through the duration of the resumed season) than those who did not, although such ef¬ 
fect is not apparent in the short run (within a month after the season started). Additionally, 
there is no evidence of a beneht or drawback for North American players. 

Our results suggest that playing overseas during the lockout did not systematically im¬ 
prove post-lockout player performance. Possible explanations for a lack of improved perfor- 

®Out of the approximately 400 players who stayed in North America during the lockout, 169 of them 
chose to play in the American Hockey League (AHL). The AHL is considered to be less competitive than the 
NHL and many of the European leagues because it serves as the primary development league for the NHL 
and caters to primarily inexperienced young players who are just starting a professional career. 
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mance from playing abroad include: (1) the lockout may actually motivate all players to exert 
effort to prepare for the new season, regardless of the location and format of preparation; 
(2) the relatively short duration of the lockout may not allow any signihcant performance 
gap to form, especially since timely resolution was already expected based on past lockout 
experience in the NHL; (3) European hockey leagues are different from the NHL in terms 
of intensity, rink sizes and rules, which may require signihcant adjustment from players, es¬ 
pecially North American ones; (4) players may not exert full effort while playing in Europe 
due to weak hnancial incentives and concerns about potential injuries, and they may also 
have chosen to play in Europe for non-competitive and non-monetary reasons. 

Our paper makes the following three contributions to the literature. First, by identifying 
the effect of playing abroad on post-lockout productivity, our study is the hrst paper that 
provides evidence on the impact of labor conhicts and work stoppage on employee perfor¬ 
mance in the held of professional sports. Secondly, economists and statisticians have recently 


started to utilize matching techniques in the held of sports economics (e.g. De Paola and 


Scoppa, 2011 and Krumer et ah, 2014), and our paper is among the hrst to employ propen¬ 


sity score matching to study causal inferences in sports industrial relations. Lastly, this 
paper contributes to our general understanding of the ehect of employer-initiated lockouts, 
an increasingly popular phenomenon across industries, on labor productivity and provides 
policy implications. 

Our paper is organized as follows. Section 2 provides background information on the 2012- 
13 NHL Lockout. Section 3 introduces a simple conceptual framework for our study. Section 
4 outlines the propensity matching technique employed in the study. Section 5 describes the 
data used in the study, and present results from the design and analysis phases. We then 
discuss the empirical results in Section 6 followed by concluding remarks in Section 7. 
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2 Background on the 2012-13 NHL Lockout 


Due to disagreement between the owners and the players on revenue sharing schemes and 
contract structures, the four professional leagues of major sports in the U.S. have witnessed 
more than a dozen strikes and lockouts in the past four decade^ A strike happens in a 
labor dispute when players collectively refuse to play for a number of games while a lockout 
is the cancelation of part or all of the professional season initiated by team owners. Since 
the 1994-95 MLB strike that resulted in the cancelation of the remainder of the season, 
work stoppage in professional sports has since been predominantly in the form of lockouts 
because lockouts offer a clear bargaining advantage for the owners by transferring most of 
the financial burden to the player^ ( [Staudohar 2013). Among the the recent lockouts in 
professional sports leagues, the NHL became the first professional league in North American 
to cancel the entire season as a result of the 2004-05 lockout. 

Following the season-ending lockout in 2005, players and the NHL reached a 7-year 
agreement, due to expire by the beginning of 2012-13 season. Despite a strong growth of 
over 50% in league’s revenue and additional TV broadcast deals during the seven seasons 
following the lockout, the revenue was generated and kept by a few large city teams and 
almost half of the teams claimed to have incurred a hnancial loss in the 2011-12 seasor|3 On 
the other hand, players were not as affected by their teams’ worsening hnancial conditions, 
thanks to the 57-to-43 split on the hockey-related revenue between players and owners. Such 
disparity in economic well-being between the players and the owners naturally led to strife 
when the renewal time came for a new collective bargaining agreement. Specihcally, owners 
intended to drastically reduce players’ share of the hockey-related revenue while players were 
reluctant to budge and instead demanded proht sharing among team^ Owners also hoped to 


® “Pro Sports Lockouts and Strikes Fast Facts”, The CNN Library, July 28, 2014. 

lockout is announced prior to the start of the season, which means players are not being paid for 
each day they are on the labor dispute with the management and thus shifts much of the economic burden 
of work stoppage to players. 

®“NHL Team Values: the Business of Hockey”, Forbes.com, November 28, 2012. 

® Owners hoped to reverse the split ratio to 57-43 favoring owners while players were willing to lower 
their share by only a few percents if there was a new revenue sharing among teams. 
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increase the free-agency threshold to age 30 as well as ten full years of NHL experienc^^ The 
negotiation started near the end of the 2011-12 season, but no agreement was made before the 
old collective bargaining agreement expired on September 15, 2012. The NHL called a lockout 
for all pre-season games on September 19 and progressively canceled all regular-season games 
up to January 14, 2013 as the two parties continued to disagree on the make-whole issue 
(i.e. whether to honor contracts from previous agreement) and the length of contracts. Just 
as the hope for a new season started to dim, the two parties resumed the negotiations with 
mediation from the Federal Mediation and Conciliation Service and miraculously narrowed 
their disagreement within days. On January 6, the two parties reached a tentative new 
collective bargaining agreement to end the lockout, and a 48-game new season started on 
January 19, 2013 following a rushed week of training camp. 

Since the 2012-13 NHL lockout canceled only part of the season, it provides a unique 
natural experiment to study the impact of labor strife and work stoppage on player produc¬ 
tivity While waiting for the settlement to be reached, approximately 200 players began 
signing contracts with teams in European league^^ and a few players also considered signing 
with the AHL. The 2012-13 NHL lockout thus offers a further identihcation advantage in 
studying the impact of the lockout on player productivity because there are players who 
could not only receive compensation but also stay in competitive conditioning by playing in 
European leagues while the rest of the players decided to practice on their own or played in 
less competitive games such as those in the AHL and received nominal or no compensation 
during the lockout. These features of the NHL lockout allow us to formulate a simple concep¬ 
tual framework and test whether playing overseas effects future performance. We would not 
be able to explore such identihcation strategy for the NBA or NFL lockouts because those 

^°Under the 2005 agreement, the age and tenure threshold for unrestricted free agent is age 27 and 7 
years, respectively. 

^^If the entire season were canceled, the new season would resume following the off-season of the canceled 
season. The impact of the lockout would be blurred by the fact that players could be more prepared when 
they had an extra off-season to prepare for the new season. 

^^Major European hockey leagues that NHL players played at during the 2012-13 lockout include Konti- 
nental Hockey League in Russia, Hockeyallsvenskan in Sweden, National League A in Switzerland, SM Liiga 
in Finland and etc. 
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lockouts did not cause large outflows of players to temporarily play in other comparable 
professional leagues. 


3 Conceptual Framework 


We present a simple conceptual framework and provide testable hypotheses in this sec¬ 
tion. Much of the literature on sports production functions focuses on team performance, 
and researchers have adopted linear specification ([Scully 1974), log-linear functional form 


(Gustafson et ah, 1999), CES function (Bairam et al., 1990), and stochastic production fron¬ 


tier model (Kahane, 2005). In our study, we are interested in the impact of lockouts on the 


performance of individual players rather than teams. And we would argue that the player’s 
morale and effort are likely to be affected during a lockout because of the financial loss as 
well as the uncertainty about future. Thus, we incorporate effort as a key input in player’s 
individual production function and explore its role in a player’s preparedness for the resumed 
season. Since players were in principle not paid by the NHL or their respective teams during 
the lockoutj^ players’ effort may be driven by additional financial compensation they found 


elsewhere as well as their expectation about the length of the lockout. Similar to Lee and 


Rupp (2007), we then model individual player’s effort following the partial gift model by 


Akerlof (1982). We treat effort E as a function of wage offer (during the lockout) w and 
player’s view about the survival probability of the lockout h, which further depends on how 


long the lockout has lasted t 


E = E{w, h{T)) 


( 1 ) 


where 

^^The NHL players’ association did issue a lockout pay to all players on a monthly basis during the 
lockout. The pay was between $5,000 and $10,000 per player, which was insignificant compared to players’ 
regular salary. 

^^Much of the literature on effort focuses on incentivizing effort using specific pay structures. This is 
not the focus of our study as we intend to use a simple framework to highlight the role of effort and its 
determinants in players’ relative preparedness for the season. 
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This setup implies that effort is increasing in wage and decreasing in player’s perception 
of the survival probability of the lockout. We thus hypothesize that if the European clubs can 
offer signihcant compensation, players who played overseas would exert more effort during 
the lockout than those who trained domesticallj|^ As the lockout progressed, our model also 
suggests that players who were practicing on their own or playing for limited compensation 
during the lockout would perceive the end of lockout to be less likely. The erosion of trust, 
uncertainty about professional development and hnancial stress may depress these players 
and cause them to exert less effort over time, which also implies the costly nature of effort 
in our setting]^ 

Since the employer monopsony power in sports has exhibited similar effect as found in 


other occupations such as public school teachers (Kahn, 2000), we adopt an individual player 
production function following the literature on labor strife and the performance of public 


school teachers (e.g. Todd and Wolpin, 2007 and Turner, 2013): 


Yu = Y{Eu,Xu,^^) 


( 2 ) 


where 17 * is a performance measure for player i at time t, E^ is the effort level as dehned 
in Equation (1), Xu is a set of individual and team inputs that positively contributes to 
productivity, including age, number of competitive games played, and etc, and is player’s 
endowed ability. Detailed descriptions of 1** and Xu in the context of our data are provided 
in Section 5. Because we posit that effort, morale and experience (number of competitive 
games played) are positively linked to player performance in our model, we hypothesize a 


is worth noting that, consistent with our framework, the impact of compensation on effort may be 
small during the recent NHL lockout since it is reported that many NHL players only received nominal 
compensation (especially compared to their NHL contracts) for their games in Europe. 

^®There may also exist a hunger effect as the lockout progressed, i.e. as players started to worry about 
their career or even making a living, they would actually be motivated to put in more effort. This would 
then make the effect of lockout duration on effort ambiguous. 
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productivity gap between players who play overseas and players who stayed in North America 
during the lockout due to the hnancial gains from playing in European leagues as well as 
additional number of competitive games playecj^ Our framework also implies that such 
productivity gap may widen as lockout progressed due to diverging effort levels. 


4 Matching Technique 


We adopt the notation of the Rubin Causal Model (RCM), initially described by Splawa- 


Neyman et ah (1990 [1923]) for randomized experiments and adopted for observational data 


by Holland (1986). Let Yi be a player-specihc performance measure for player i, i = 1, ...,n, 


where n is the total number of players, and is measured after the lockout. Let Ti be our 
treatment variable, Tj = {0,1}, indicating whether or not player i played overseas during 
the latter months of 2012, and let Xi be a set of covariates that are associated with Y^ and 
Ti. The variables in Xi are ‘pre-treatment’ variables; that is, they are measured before a 
player made the choice to play overseas. 

It is a common practice within the RCM to make the stable unit treatment value assump¬ 
tion (SUTVA). SUTVA states that both the treatment assignment of one subject does not 
impact the set of potential outcomes for other subjects, and also that there are not multiple 
versions of each treatment. Under SUTVA, the potential outcome for i can be written as 
Yi(Ti = t) = Yi(t), which is the outcome we would have observed had i received t. 

Our specihc estimand of interest is the effect of playing overseas among the players who 
chose to play overseas, referred to the average treatment effect on the treated, ATT, where 


ATT = E[Y{T = 1) - V(T = 0)|T = 1]. 


(3) 


The ATT is commonly estimated by averaging the difference in potential outcomes among 


mentioned earlier, since Europe affords the most competitive hockey leagues outside the NHL, we 
assume that games in European leagues are more competitive than AHL games or individual training on 
one’s own. 
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the population that chose to play abroad, ^ X] = 1)J i where /(T* = 1) 

is an indicator variable for whether or not player i played overseas and n* is the number of 
players that chose to play overseas. Because only 1^(0) or Yi{l) is observed for each player, 
ATT must estimated from the data by imputing the missing potential outcomes. This issue 


is referred to as the fundamental problem of causal inference (Holland, 1986). 

To approximate the unobservable potential outcome, the RCM requires the as¬ 
sumption of strong unconfoundedness, which states that (i) Pr({y(0), y'(l)} |T, X) = 
Pr{{Y (0), Y (1)} |X) and (ii) 0<Pr(T = t\X) for t G {0,1} ( Rosenbaum and Rubin| (1983)). 
Under strong unconfoundedness, treatment assignment and the set of potential outcomes are 
independent given X, and as a result, the contrast of outcomes with the same X provides 
an unbiased estimate of the treatment’s causal effect to units with that X. 

For a multidimensional X, individual matching is difficult and often infeasible. Instead, 
matched methods using propensity scores are popular for estimating the ATT and related 


treatment effects (Rosenbaum and Rubin, 1983). The propensity score is dehned as r{t, X) = 
Pr{T = 1|X). Under strong unconfoundedness, if two individuals have the same r{t,X) 
but different treatment assignments, the difference in their outcomes provides an unbiased 
unit-level estimate of the treatment’s causal effect. For a further description of propensity 


scores with a dichotomous treatment assignment, see Stuart (2010). 

Before we look at the data, it is important to point out the unclear validity of SUTVA in 
our example. For North American players, the possibility of language barriers, difficulty of 
identifying living arrangements, and a less traditional style of play are all factors of playing 
overseas that, in all likelihood, made playing abroad easier for European players. It is 
perhaps too strong of an assumption to believe that North American players and European 
players received the same experience after choosing to play abroad. Moreover, empirical 
evidence has shown that European players earn relatively favorable wages in the NHL, and 
that they were more likely to have played abroad during the lockout, implying that there 


are additional distinctions between the two cohorts (von Allmen et ah, 2015). In light of 
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the difficulty in making the constant treatment assumption, we make the a priori decision to 
estimate causal effects separately for each subgroup; one treatment effect for North American 
players {ATT^a), and another for European players {ATTe). 


5 Data and Empirical Results 

To ensure a large enough sample of games in each season on which to compare players, 
we only considered players that participated in at least half of the season’s games in each 
of the 2011-12 and the shortened 2012-13 seasons. We eliminated the 16 goalies from the 
NHL that played abroad; goalie performance has been shown to be inconsistent over time 


(Berri and Brook, 2010), and so we focus on skaters, for whom there is a larger sample 


size. This yielded a sample size of 539 NHL forwards and defensemen, 404 of which were 
from either the United States or Canada (72%). The remaining group of 125 skaters, for 
simplicity, will be referred to as the Europeans; these players are primarily from Sweden 
(36 players, 7%) and the Czech Republic (31, 6%), with others also from Austria, Belarus, 
Finland, France, Germany, Kazakhstan, Latvia, Lithuania, Norway, Russia, Switzerland, 
Slovakia, Slovenia, and the Ukriane. Player nationalities were extracted from the website 
<http: //www.quanthockey. coni>, 

A player’s participation in overseas competition was cross-checked using a list published 
on <www.tsn. ca>, A much larger percentage of European players (63%) chose to play over¬ 
seas, relative to North American ones (17%), perhaps speaking to the perceived advantages 
that players from Europe would have upon returning to play near their hometowns. 


5.1 Design phase 

A matched analysis should be separated into two phases; the design phase, which is done 


without the outcome in sight, and the analysis phase (Rubin, 2001). The goal of the design 


phase is to reduce the bias in the covariates’ distributions between those who received the 
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treatment and those who did not. In essence, we attempt to replicate the balance from 
a completely randomized design, under which those treated and untreated are similar in 
expectation with respect to observed covariates. While a randomized design also provides 
the beneht that unobserved covariates are also similar in expectation, like with many other 
examples, the randomization of players to participate in overseas competition during the 
lockout would have been infeasible and unethical. 

Choice of X should be driven to satisfy the assumption of strong unconfoundedness, 
and Stuart ( 2010| recommends including any pre-treatment variable known to be associated 
with both treatment assignment and the outcome. Factors that may influence a player’s 
choice to play abroad and his subsequent performance include his overall performance level 
prior to the lockout, salary, age, and position. Given our desire to estimate treatment effects 
separately for North American and European players, covariate matrices are distinct for each 
cohort. 

We identihed 13 variables for our propensity score model, drawn from familiarity with 
the sport of hockey and literature written around the time of the lockoutp^ These variables 
are listed in Table along with a brief description. The hrst ten variables {Shot%, ... , 
Time on ice) represent player statistics from the 2011-12 season, and were each extracted 
from the website <www. war-on-ice. com>. Shot% is defined as the percentage of on-ice shot 
attempts (on goal or missed) taken by a players team when that player was on the ice. Among 
hockey analytics followers, this variable is known as a players’ Corsi percentage. Empirical 
evidence has found that Shot% percentage is preferred for predicting a players’ future success 
over statistics like goals, assists, and plus/minus rating, because the latter metrics are more 
variable (Schuckers et ah, 2011 Macdonald] 2012). Moreover, possession measures such as 
relative Shot% are more informative for evaluating the performance of defensive players, 
whose primary roles on the ice may not come on offense. Remaining variables are drawn 
from <www.war-on-ice.com>, and help account for a players position (defense or forward). 


^®Including, among others, <http;//thehockeywriters . com/nhl-players-go-overseas/> and<http; 
//www.wsj.com/articles/SB110565436846425695>, 
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his offensive production, and proxies for his aggressiveness, such as hits and penalties. 

The eleventh variable in Table[^ Salary, represents the player’s yearly salary for the 2011- 
12 season, and was extracted using <www.capgeek.com>, Finally, we include each player’s 
age as of February 1 of the 2011-12 season. Age, taken from <www.hockey-reference.com>, 
and we add a squared term for age to account for a possible non-linear trend between Age 
and the probability of playing overseas. 


Table 1: Covariates 


Variable 

Description 

Shot% 

Shot percentage, 2011-2012 season 

Defense 

{1 for defensemen, 0 for forwards} 

Goals 

Goals per 60 minutes, 2011-12 season 

Assists 

Assists per 60 minutes, 2011-12 season 

Games 

Games played, 2011-12 season 

Hits 

Hits, 2011-12 season 

Hits Taken 

Hits taken, 2011-12 season 

Penalties 

Penalties, 2011-12 season 

Penalties Taken 

Hits taken, 2011-12 season 

Time on ice 

Time on ice per game, 2011-12 season 

Salary 

Salary, 2011-12 season 

Age 

Age, in years 

Age Squared 

Age^ 


After estimating the propensity score using separate multivariate logistic regression mod¬ 
els for each of the the North American and European players, we match subjects based on 
their estimated propensity score, f(t,X), by using the Matching package in R statistical soft¬ 
ware ( Sekhon| 2008). Given that matching with replacement has been shown to yield sets 
with lower bias, relative to matching without replacement, we match with replacement using 


a caliper of 0.10 (Abadie and Imbens, 2006). Further, because our outcome variables include 
offensive output measured after the lockout, we use exact matching by position, which en¬ 
sures that defensemen are only matched to defensemen and forwards are only matched to 
forwards. 

Table shows one example of a matched pair, European forwards Henrik Zetterberg and 
Daniel Sedin, along with a subset of variables from Table [T] and their estimated propensity 


14 












scores. The two players are similar on many of the variables in X, including Age and 
Salary, although Zetterberg posted a higher goal total, lower assist total, and a better 
Shot%. Additionally, the f(t,X)’s for Zetterberg and Sedin are within 0.01 of one another. 


Table 2: Example of players matched and selected covariates 


Ethnicity 

Position 

Player 

Abroad? 

At,x) 

Goals* 

Assists* 

Shot%* 

Salary* 

Age 

European 

Forward 

H. Zetterberg 
D. Sedin 

Yes 

No 

0.704 

0.695 

30 

22 

37 

47 

66.9 

60.0 

6.10 

6.08 

31 

31 


*For the 2011-12 season. Salary taken in millions of dollars 


Figures]^ and [^depict the distributions of r{t, X) for the North American and European 
players, respectively. Each of the darkened circles in Figures [T] and refer to a player that 
was matched to someone with the other treatment, and represent the cohort of players that 
we can generalize to, while subjects not matched are depicted by open circles. 


North American players 



Estimated propensity score 


Figure 1: Distribution of estimated propensity scores. North American players 


In general, the distributions of propensity scores among those matched appears roughly 
similar within both the North American and European player cohorts. The f(t,X)’s for 
North American players, on average, are much lower than European players, and there is 
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Figure 2: Distribution of estimated propensity scores, European players 


a large group of North American players with a very low estimated probability (<15%) of 
playing overseas. All but four players in the North American cohort that went overseas were 
matched to a player who did not play overseas; the four subjects not matched did not have 
a corresponding player at the same position with a similar f{t, X). 

For European players, most f{t, X)’s were between 0.40 and 0.95. There were a handful of 
players that played overseas with too large of an estimated probability of playing abroad, such 
that there was no corresponding player to be matched to among the Europeans who chose 
not play overseas. Including subjects with extreme propensity scores requires extrapolation. 


and it is often recommended that subjects in this group be discarded (Dehejia and Wahba 


1998). As a result, these players were not included in our analysis phase. 


Differences in the covariates’ distributions between treatment groups is commonly as¬ 


sessed using standardized bias (Austin, 2009). Let Xpi and Xpo be the sample mean of 
covariate p among subjects with receiving the treatment and control, respectively, and let 
cTpi be the standard deviation of covariate p in the treatment group. The standardized bias 
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of covariate p, SBp, is calculated as 


SBp 


Xpi ^p2 

^pl 


(4) 


Rubin ( j2001 ) recommends that defensible causal statements can be made only if the stan¬ 
dardized bias between the treatment and control groups are less than 0.25 for each covariate. 

We calculated the standardized bias between players who played overseas and those that 
did not, both before and after the matching. Figures and show ‘Love’ plots of the pre 
and post-matched absolute standardized biases for both the North American and European 


cohorts, respectively (Ahmed et ah, 2006) 
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Figure 3: Absolute standardized biases. North American players 


Of the thirteen standardized biases in each of the unmatched groups of players, eight are 
greater than 0.25 for each of the North American (in descending order, Age^, Age, Goals, 
Assists, Shot%, Penalties, Defense, and Games) and European {Games, Hits, Age^, Hits 
taken. Penalties, Time on ice. Age, and Penalties Taken) cohorts. After matching, the 
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European players 
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Figure 4: Absolute standardized biases, European players 


standardized bias for each variable is less than 0.25 in both groups, and for most variables, 
the standardized bias is less the 0.10 among matched subjects. Given the reductions in 
bias after matching, it appears reasonable to consider the covariates’ distributions balanced 
between the different treatment groups within the matched cohort. 

Figures [^-|^ also highlight the potential weaknesses of relying on regression-based strate¬ 
gies, such as multiple linear regression or a difference-in-differences design. More than half 
of the covariates’ bias in the full sets of each of the North American and European players 
are greater than 0.25, which is problematic because differences in the distributions of X 
between treatment groups can lead to biased regression-based estimates when the regression 


model is misspecihed (Cochran and Rubin, 1973 Rubin, 2001). Further, there is a large sub¬ 
set of North American players with near-zero probabilities of playing abroad; attempting to 
identify the effect of playing abroad on players who may not have actually been able to play 
abroad, as would be done using a regression approach, requires extrapolation and making 
unjustihable assumptions. Finally, in general, regression-based strategies are more sensitive 
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to covariate choice and model specification when compared to matched designs, and perform 


poorly in areas with limited covariate overlap (|Dehejia and Wahba 1998; Stuart, 2010). 


5.2 Analysis phase 


We chose three measures to judge a player’s performance after the lockout; his goals per 60 
minutes, his assists per 60 minutes, and his Shot% (Corsi percentage). We also investigated 
a player’s performance in both the short run (one month since the season resumed) and long 
run (the entire resumed season) because one may expect the performance gap to be short 
lived. 

Differences in outcomes are contrasted within the matched cohort. Under unconfound¬ 
edness, these comparisons provide unbiased estimates of the effect of playing overseas on on 
NHL players’ outcomes. Table shows the treatment effects for our three outcome variables 
in both the short run and the long run. We used Abadie-Imbens standard errors for each 
treatment effect, which helps account for the uncertainty in the matching procedure (|Abadie 


and Imbens 


2006 


Our results indicate limited support for enhanced productivity as a result of playing 
overseas during the lockout. In particular, we find that for European players, those who chose 
to play overseas during the lockout had significantly more goals per 60 minutes (p — value < 
0.01) during the shortened 2012-13 season than those who did not. In our cohort, this 
difference represented between roughly 2 and 3 more goals per season among the Europeans 
that chose to play abroad. 

We do not observe similar significant productivity gain (in terms of goals per 60 minutes) 
among European players in the short run. One reason could be because the season resumed 
on short notice, which can result in high transition cost for those who played in Europe since 
they would need to almost immediately report to the team and adjust to the new season 
in North America. For all the other outcome variables, there is no evidence of a significant 
positive or negative treatment effect of playing overseas on player outcomes regardless of the 
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time frame or ethnicity. 


Table 3: ATT of playing abroad 



North Americans {ATTi^a) 

Europeans [ATTe] 

Variable 

One Month 

Full Season 

One Month 

Full Season 

Goals/60 
Assists/60 
Shot% 

-0.021 (0.067) 

-0.027 (0.123) 

-0.049 (1.387) 

-0.031 (0.060) 
-0.019 (0.087) 
-0.447 (1.116) 

0.080 (0.072) 
-0.154 (0.119) 
-1.621 (1.786) 

0.158 (0.057)*** 
0.007 (0.941) 
-1.787 (1.604) 

Standard errors in parentheses 




*p <0.10, 

<0.05, ***p<0.01 





6 Discussion 


The matching results indicate that playing overseas during the 2012-13 NHL lockout did 
not consistently offer a competitive advantage, which suggests that player behaviors during 
the lockout may not have systematically affected individual players’ performance. While 


the results are consistent with hndings from select studies such as Lee and Rupp (2007), 


they disagree with other prior studies on labor disputes and productivity such as Mas (2006) 


and Krueger and Mas (2004). We take into account the unique aspects of the 2012-13 


NHL lockout and propose the following four possible explanations that are in line with our 
conceptual framework focusing on the impact of effort and experience on player productivity. 

First, much of the previous literature on labor strife and productivity considers strikes 
instead of lockouts. Because strikes are initiated by workers while lockouts are imposed 
by employers, workers are more unprepared and have less control over the situation under 
lockouts, whereas if the workers are able to strike, then they may also intentionally shirk to 
exert more pressure toward the employers. And in the case of NHL, since the lockout was 
imposed before the season started, players also carried more of the hnancial burden - the 
lockout resulted in a signihcant hnancial loss to the players since an NHL player’s annual 
salary is often on a million-dollar scale. The temporary but hefty hnancial loss together 
with the feeling of lack of control over the negotiation may actually motivate all players to 
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exert more effort into their extended off-season, regardless of whether they chose to engage 
in training domestically or playing competitively overseas, though effort may be more costly 
for those who stayed in North AmericaP^ Studies, e.g. Lee and Rupp (2007), on industries 
where employees collect large labor market rents also hnd limited support for reduced effort 
and productivity among commercial airline pilots when facing pay cuts^ 

Secondly, the lockout lasted only three months, which may not be enough time for sizable 
productivity difference to formp^ Moreover, there was also wide expectation that owners 
and players would learn from the previous lockout and the lockout would resolve in a timely 


manner because of the tremendous hnancial loss caused by the previous lockout (Staudohar 


2013). Such expectation and hope could alleviate some of the uncertainty that players feel 


about the future and help them focus on improving their competitive strength. Since players 
expected that the season could resume at any given moment, those who chose not to play 
overseas would exert as much effort in their training as those who played overseas to be 
ready for in-game competition. 

Furthermore, the advantage of playing more competitive games in European leagues may 
be offset by the high transaction costs and heterogeneity in competitiveness. Besides new 
teammates, coaches and fans, there are other nontrivial differences between European games 
and NHL games, which require signihcant and costly adjustment from the players. For 
instance, European games follow a different rink sizt^^, rules (Olympic hockey rules) and 
playing styles. The fact that we hnd limited productivity gains for European players but no 
impact for North American provides further evidence to this argument since it is presumably 
easier for European players to adjust to European leagues due to their background and expe- 


^®Besides the differences in compensations, those who played aboard may also find it easier to maintain 
and improve competitive conditioning due to the zero-sum nature of hockey games and competitiveness of 
European leagues. 

^°The scale of labor market rent in occupations such as commercial airline pilots is of course not compa¬ 
rable to professional sports players. 

^^It is also possible that the veteran players are used to keeping up their conditions during the annual 
off-season. A short lockout may be viewed by some as an extended off-season, and it may not influence a 
player’s competitiveness if he follows his routine off-season training schedule. 

^^The NHL rink is 200 feet by 85 feet with goal lines being 11 feet from the end boards, while in most 
European leagues, the ice rink is 210 feet by 98 feet with goal lines being 13 feet from the end boards. 
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rience. Long-distance travel between North America and Europe can also negatively affect 
athletic conditions, especially when the new season resumed on short notice. Despite being 
the most competitive option outside the NHL, few European leagues can match the NHL in 
terms of competitiveness and talents, and there is strong heterogeneity in competitiveness 
among the European leagues. 

Lastly, those who played overseas may not perceive European leagues as their long term 
destinations, and thus may not exert full effort during their stay in Europe. Such hesitation 
could be due to the relatively weak financial offers from European club^^and fear of injuries 


that may affect their NHL careei Because most of the players who played overseas during 
the lockouts are European players, it is possible that some of them may also have chosen to 
play in Europe for non-competitive reasons - it may simply be because these players would 
prefer to be close to home during the lockout just as most American and Canadian players 
chose to stay domestically during the lockout. 


7 Conclusion 


In this paper, we utilize a propensity score matching technique to present the first set of 
evidence on the impact of labor supply decisions during labor strife and work stoppage on 
worker productivity in the context of professional hockey players. In particular, we consider 
a unique natural experiment from the 2012-13 NHL lockout, during which approximately 
200 players decided to play overseas while the rest stayed in North America and practiced on 
their own. We find limited evidence of enhanced productivity only among European players 
who chose to play abroad during the lockout, and no evidence of a benefit or drawback for 


^^For instance, Russia’s KHL, one of the highest paying leagues in Europe, limited the compensation of 
locked-out NHL player to no more than 65 percent their NHL salary (pro rata). And there are reports of 
players who took nominal compensation or were paid on a per-game basis for their games in Europe. On the 
other hand, the NHL Players’ Association offered its members an escrow payment in October that was worth 
8% of previous year’s salary, which already surpassed many of the short term or per-game based contracts 
offered by European clubs. 

Adding to these factors is also the fact that player insurance provided by the NHL teams does not cover 
games played outside the NHL. 


22 




North American players. This suggests that playing overseas during the lockout did not 
systematically improve the post-lockout player productivity, from which we can infer that 
player behaviors during the NHL lockout did not consistently affect a player’s performance. 
Possible explanations for the lack of consistent productivity changes include: (1) lockouts 
(as opposed to strikes) could actually create incentives for all players to exert effort; (2) 
the 2012-13 NHL lockout ended quite early with timely resolution already expected based 
on past lockout experience; (3) European games may differ from the NHL ones in terms 
of intensity, setup, and rules; (4) there may be hesitation to exert full effort while playing 
abroad due to weak hnancial incentives and injury concerns. While our results may not fully 
agree with previous empirical evidence from manufacturing and public sectors, our Endings 
are consistent with literature on labor conflicts and worker performance in industries where 
employees collect large labor market rents, e.g. commercial airline pilots. 

While we made use of the most recent NHL lockout, a related analysis would contrast 
hockey players before and after the entire 2004-05 season was lost. However, not only would 
it be difficult to ascertain information about which players chose to play abroad during this 
period, such an analysis could be compromised by the myriad changes to league policies 
made before the start of the 2005-06 season, including the implementation of the shootout. 


which were designed to increase game scoring and excitement. Franck and Theiler (2012) 


and Lopez (2013), for example, identified changes in game outcomes and when comparing 
behavior before and after the 2004 lockout. In this respect, the analysis of the 2012 lockout 
would be preferred; when NHL play resumed after in January of 2013, it did so with, by and 
large, the identical set of rules and incentives to the previous season. A related area could 
consider the effects of mid-season stoppages in play, although, admittedly, these are rare in 
professional sports. 

Within the field of professional sports, our study suggests that playing in alternative 
leagues in the event of league lockouts may not offer a systematic advantage over self- 
motivated practices especially if the lockouts are expected to be short-lived. On a broader 
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note, with the decline of union representation and increasing empowerment to employers 
in many industries, it is important to understand the effect of lockouts as an alternative 
form of work stoppage during labor disputes, particularly in terms of its impact on labor 
productivity. Much of previous literature on work stoppage and labor productivity hnds 
that worker productivity suffers as a result of strike. In contrast, our results imply that 
labor outcomes may not be affected under lockouts. One channel that helps explain the 
difference is that strikes and lockouts can create different incentive schemes for the parties 
involved. A broader policy implication of our hndings is that consumer welfare may not suffer 
as much after a lockout compared to a strike due to the relatively unaffected post-lockout 
worker productivity and resulting product quality. Since the ability to impose a lockout can 
offer a significant bargaining advantage, lockouts are justihably restricted in order to protect 
workers’ welfare in the collective bargaining process. In light of the increasing percentage of 
lockouts in recent labor stoppage incidents, policy makers thus need to evaluate the welfare 
tradeoffs between employees and consumers when considering legislative changes to either 
form of work stoppage. 
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